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rtATA TNTRGRATION AND REGISTRATION METHOD AND APPARATUS 
FOR NON-DESTRUCTIVE EVALUATION OF MATERIALS 




TECHNICAL FIELD 
The present invention is directed to a method and apparatus for non-destructive 
testing and evaluation of materials, and more particularly to a method and apparatus for 
identifying and registering defects in a sample by superimposing a defect image over a 
live image to locate subsurface defects in the sample. 



10 BACKGROUND ART 



Various methods of non-destructive testing and Evaluation (NDT/E) of parts have 
been developed to detect subsurface defects in a part sample and to measure the depth of 
subsurface defects. These methods include step thenftography, pulse thermography, 
pulse thermography, and other thermographic techniques. All of these techniques 
15 involve deliberately changing the temperature of the sample, allowing the sample to 
return to equilibrium temperature, and observing^ the temperature change of the sample 
via an infrared camera. Anomalous temperatupfe changes that appear in the infrared 
camera image indicate subsurface defects in the sample; subsurface defects tend to 
impede the normal heat fiov/ in the sample and will appear as anomalies in the image. 
20 Further, because the infrared image showing the defect is transient and may last for only 
a fraction of a second, the image must be/fcaptured (usually with a digital computer) and 
then verified with the actual sample to locate the defect. 

The actual verification process/ usually through a complementary NDT/E 
process, can be relatively difficult because the infrared defect image of the sample may 
25 bear little resemblance to the actualiample. For example, many subsurface defects 
appear only in the infrared image; to the naked eye, the sample containing the defects 
often appears perfectly uniform. As a result, a user must attempt to match the image of 
the subsurface defect with the actual, unblemished sample surface to pinpoint the 
location of the defect. This is further complicated by the fact that the infrared camera 
30 lens often distorts the image, ciusing straight lines at the periphery of the lens's field of 
view to appear curved in the i^age. To locate and mark the positions of subsurface 



defects with some precision, prior art methods/ include using regularly spaced registration 

markers on the sample, calculating complexAnamorphic mapping algorithms, or printing 

a full-size defect image and physically matching or overlaying the full-size image onto 

the actual sample. Because the sample m4y not have any distinguishing marks that 

\)5 appear in the defect image, precise registration of the image and the sample's surface can 
* / 
>^ be difficult. In addition, these method/ are time-consuming and are not particularly 

convenient, and at best they can only Approximate the subsurface defect location due to 

the image distortion from the infrardd camera lens. Further, measuring the depth of 

subsurface defects often requires sc&me prior knowledge of the sample's dimensions or 

10 properties, such as the thickness c/f the sample, the depth of a known defect, the 

material's thermal diffusivity, et/ This information is often not available in practice, 

making precise depth measurements difficult with known techniques. 



Thus, there currently is a need for a NDT/E technique that allows accurate 

annotation, marking, and thickness measurements of specific locations on a sample, 

15 without the problems caused by differences between the image and the actual sample due 
to image distortion. There is also a need for a NDT/E technique that can conduct depth 
measurement without requiring prior knowledge of any of the sample's characteristics. If 
the depth and onset time (relative to the heating event) of a single defect are known, it is 
then possible to calculate the thermal diffusivity of the material and to use it to determine 

20 the depths of other defects from their offset time, according to the well-known relation of 
t = d^ / D, where t is the onset time, d is the depth of the defect, and D is the thermal 
diffusivity of the sample. 



SUMMARY OF THE INVENTION 
25 Accordingly, the present invention is a method and apparatus for conducting . 

NDT/E that simplifies the correspondence between image information obtained during 
NDT/E and the actual sample. More specifically, the invention involves obtaining a 
defect image and a live image of the same sample and then superimposing one image on 
the other. One embodiment of the invention is directed to linking the information 
30 regarding surface defects obtained during infrared NDT/E to the actual part being 

inspected. The invention includes generating a defect image of the sample via infrared 
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imaging or some other means. The defect image may have markers or other indicia 
locating where subsurface defects are in the sample. The defect image is then 
superimposed onto a live image of the sample. A user then views the live image of the 
sample, rather than the sample itself, while transferring the marks from the defect image 
to the sample. Because both the defect image and the live image are distorted by the 
infrared camera lens and therefore have a one-to-one correspondence, the distorted image 
is used as the frame of reference for locating subsurface defects and marking the sample. 
This ensures that the marks in the defect image are transferred precisely from the defect 
image onto the sample and also eliminates the need to map the distorted image to the 
sample in a separate step. 



BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a flowchart illustrating an evaluation and testing method according to 

the present invention; 

Figure 2 is a flowchart illustrating an example of the inventive method as applied 

to thermography; 

Figures 3a through 3f illustrate actual images taken from infrared NDT/E of an 
aluminum aircraft panel according to the method of the present invention; and 

Figure 4 is a representative diagram of an apparatus that can be used to annotate, 
calibrate, and/or evaluate a sample according to the method of the present invention. 

DETAI LED DESCRIPTION OF THE PREFERRED EMBODIMENT 

Referring to Figure 1, ona^embodiment of the NDT/E method according to the 
present invention can be broker/down into four steps. First, a defect image of the sample 
is obtained 100, digitized and displayed on a computer 102 using a computer program 
that has a referencing mechanism, such as drawing tool that allows the user to draw on 
the'defect image using a mouse, touch screen, light pen, or other pointing device. The 
user can mark defects found in the defect image with the drawing tool 103. The defect 
image, including any marks made by the user, is then superimposed onto a live image 
104, which is also displayed on the computer. The live image is preferably produced 
immediately thereaft/r and using the same lens and camera that produced the defect 
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image to ensure a one-to-one correspondence Imween the live image and the defect 
image; using the same lens ensures that both images will have the same distortion. The 
user then marks the actual sample, using ainarking pencil or similar device, while 
viewing the live image 106 rather than lofoking the sample itself. Instead of marking the 
part, the user may also use a point me^uring device to measure characteristics of the 
sample, such as its thickness, and ^pend the data to the image for annotation or 
calibration purposes. The defecyimage and live image can also be simply superimposed 

one atop the other for referencing purposes, without any user intervention. 

As noted above, the defect image is subject to any lens distortion that may be 
present. In the prior art, inaccuracies in marking occurred because the user was 
attempting to map the distorted defect image onto a corresponding physical sample part, 
whether it was through markers on the sample or through overlaying a full-size image on 
the actual sample. In the invention, however, the user watches the live image of the 
sample rather than the sample itself when referencing the sample. Because the live 
image and the defect image in the present invention are both distorted via the same 
camera lens, the defect image and the live image align perfectly with each other. 
Further, the user will look at the live image of the marking or measurement instrument, 
and not the actual marking/measurement instrument itself, in real time while referencing 
the sample, making it possible to trace the marks from the defect image onto the sample 
precisely and distortion-free. In short, the distorted defect image and the distorted live 
image both have exactly the same, albeit distorted, frame of reference. Thus, any marks 
or measurements taken while viewing the live image will correspond exactly to the 
marked locations in the defect image superimposed on the live image. 

Referring now to Figures 2 and 3a through 3f, the method of the present 
invention will now be described with respect to thermography. Note that the invention is 
not limited to such an application and can be used in any application where accurate 
mapping between an image of a sample and the sample itself is needed. The first step 
involves changing the sample's temperature 200 by heating or cooling the temperature 
through any known method. For example, heat can be applied to the sample via a 
flashlamp or a continuous lighting source. Defect images of the sample are then taken 
202 vvith an infrared camera as the samplers temperature returns to equilibrium. The 



infrared camera preferably obtains multiple defect images from the same sample after the 
sample's temperature is changed, taking images at selected time intervals as the sample 
returns to equilibrium temperature. Figures 3a through 3d illustrate a time sequence of 
infrared images of an aluminum aircraft pane adhesively bonded to an aluminum 
5 structural frame, illustrating the transient nature of infrared NDT/E. Figure 3a was taken 
just before heating, Figure 3b taken L33 seconds after heating, Figure 3c taken 10.67 
seconds after heating, and Figure 3d taken 39.34 seconds after heating. As can be seen 
in the figures, the aircraft panel does not exhibit any subsurface structure before heating 
(Figure 3a), while just after heating, the frame can be seen in the defect image, along 
10 with a disbonded area where corrosion has occurred, in the right half of the image 

(Figure 3b). The frame and disbonded area are less distinct after 10.67 seconds (Figure 
3c) and disappear completely after 39.34 seconds (Figure 3d). For non-destructive 
evaluation, the image obtained shown in Figure 3b provides the most useful information 
because it is the clearest image. 
15 Once the desired defect image is selected, it is digitized and transferred to the 

computer 204 for display on a computer monitor. The defect image is preferably 
displayed using a program with a "draw" mode so that the user can place marks on the 
defect image using a mouse, touch screen, or other pointing device. The area where the 
defects occur is then "marked" on the screen by the user 206. An example of such a 
20 display is shown in Figure 3e, where the image from Figure 3b is taken as the defect 
image. As can be seen in Figure 3e, the area where the plate defect appears has been 
circled by the user, using the "draw" mode in the computer program generating the 
defect image, to highlight the area at which the subsurface defect is located. 

Once the defect image is marked 206, it is superimposed onto a digitized live 
25 image 208, which is also displayed on the computer monitor. As explained above, 

because both the defect image and the live image are obtained using the same infrared 
camera lens and because the camera is not moved after the defect image is obtained, both 
the defect image and the live image exhibit the same amount of lens distortion and have 
a one-to-one correspondence with each other; the defect image and live image do not 
30 have any distortion with respect to each other. Once the defect image is superimposed 
on the live image, the user can transfer the reference marks from the defect image to the 
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sample 210 exactly and distortion-free. As shown in Figure 3f, the user does this by 
viewing his hand (or the nnarking instrument) on the sample via the live image, not by 
directly watching the physical sample. Because of the one-to-one correspondence 
between the defect image and the live image, and because the user views the live image 
5 while referencing the actual sample, the marks are made on the actual sample precisely 
correspond to the location of the defect. Alternatively, or in addition to the marking, the 
user may also contact the sample with a point measuring probe, such as an ultrasonic 
thickness gauge or thermocouple, to measure the local properties of the sample. Because 
the probe will appear in the live image, the user can mark the position of the probe oh the 
10 defect image and then read the probe measurement through a serial data connection. The 
information can be appended to the image for annotation or calibration purposes. 

Many different apparatus configurations can be used to carry out the method of 
the present invention. For example, although the above method has been described using 
a digital computer for receiving image data from the infrared camera, many infrared 
15 cameras have onboard displays and dedicated microcontrollers. Thus, most if not all of 
the steps explained above can be integrated into the camera itself. The user can perform 
the outlining/marking operation using cursor keys already resident on the camera. 
Further, the marking/annotation steps can be conducted using image processing/machine 
vision methods rather than manually by the user. Also, all of the above steps can be 
20 completely automated if, for example, a 3-D map of the sample is stored in the computer. 
In such a case, the computer itself could conduct the superimposing, referencing, and 
correlating based on the information in the 3-D map, without user intervention. 

Figure 4 illustrates one apparatus that can be used to carry out the inventive 
method with respect to thermography. The apparatus includes a reflective hood 400 that 
25 focuses light from heating lamps 402 onto a sample 404. The heating lamps 402 can be 
flashlamps (e.g. xenon lamps) or continuous lamps (e.g. halogen lamps). Regardless of 
the type of lamp used, reflectors 403 or some other means should be used to distribute 
light uniformly over the sample 404 surface at the opinion of the hood 400 so that the 
sample heats evenly. The front end of the hood 400 is open and is placed on or near the 
30 sample 404. The back portion of the hood 400 is designed to accommodate a lens 406 of 
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an infrared camera 408. The hood 400 also preferably has an access door 410 to allow 
the user to reach inside the hood 400 and mark the sample, if desired. 

The apparatus shown in Figure 4 also includes a display 412 for displaying the 
defect image and the live image generated by the infrared camera 408. The apparatus 
also includes a microcontroller or personal computer 414, which may be located in the 
infrared camera 408 itself, attached to the thermography apparatus in some other way, or 
located remotely and accessed via 2-way serial or parallel data communication. A 
measuring instrument 416, such as an ultrasonic thickness gauge, can also be provided to 
conduct thickness measurements or other measurements. Lastly, a user interface 418, 
such as an operator keypad or touch screen, is provided on the apparatus to allow 
marking of the defect image and manipulation of the images on the display 412. 

In summary, because the invention uses a distorted live image and a distorted 
defect image to locate subsurface defects, the one-to-one correspondence between the 
two distorted images creates a new frame of reference from which to pinpoint the defect 
locations, greatly increasing the accuracy and speed at which subsurface defects can be 
located and marked. The invention also allows complementary NDT/E methods to be 
used in conjunction with the defect image so that the defect image can be annotated or 
can be calibrated so thickness measurements can be obtained directly from the image, 
without requiring prior information from a reference sample or any other source. 
Further, the invention can be used with any infrared NDT/E method, independently of 
how the method changes the samplers temperature, generates the defect image, or 
processes the data. 

It should be understood that various alternatives to the embodiments of the 
invention described herein may be employed in practicing the invention. It is intended 
that the following claims define the scope of the invention and that the method and 
apparatus within the scope of these claims and their equivalents be covered thereby. 



